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LENS SHADING ALGORITHM 



Technical field 

5 

This invention relates generally to image processing and relates more 
particularly to a method and an algorithm to compensate lens shading or 
vignetting in digital images. 

10 

Background art 

Photographically, vignetting means the darkening of the corners relative to 
the centre of an image. All camera lenses suffer, more or less, of these optical 
15 phenomena. 

Fig. 1 prior art describes some major steps performed in image processing. 
In the first step 10 a raw image is obtained. In the next step 11 the offset/gain 
calibration is performed, followed by the compensation for vignetting 12. The last 
20 step 13 is the color processing. 

A simple lens obeys an optical law called the "cos-^ law" (cosine of the 
angle of incidence off the lens axis to the 4 th power. The cos-4 th influence comes 
from a number of factors, including that the light gets spread out over a larger 

25 area, and that the corners of the image are further away from the center of the 
lens than the on-axis part of the image. This means that for a lens with an angle of 
view of 20 degrees, where the maximum off-axis angle of incidence is 10 degrees, 
the corners receive cos (10 degrees) to the 4 th power as much light as the center. 
Cos (10 degrees) is 0.9848, so to the 4 th power is 0.9406. Therefore the corners 

30 get 94 percent as much light as the center, a generally imperceptible difference. A 
20-degree angle of view for a 35mm camera equates to a 123mm lens. For a 28 
mm lens, with a 75-degree angle of view, cos4th comes to 0.39. So now the 
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corners only get 39 percent of the light that the center gets. For a 20mm lens this 
goes down to 21 percent, and for a 15 mm lens this goes down to 10.5 percent. 
Obviously the last case is unworkable and is not acceptable. 

5 In order to solve said problems with lens shading, cameras are using 

typically complex optical systems, which are very expensive to manufacture. It is 
a challenge for the designers of digital cameras to design a camera having very 
low vignetting using less expensive lenses. 

io A compensation of lens shading is performed using a correction factor, 

which is dependent upon the distance of the pixel from the center of the lens. Fig. 
2a prior art shows a top view of a lens/sensor system comprising a lens 21 and a 
sensor 20. The center 22 of the lens 20, which is also the center of the sensor, 
has the coordinates X cente r, Y ce nter. A pixel 23 of the sensor 20 has the coordinates 

15 x, y. Fig 2b prior art shows a side view of said lens/sensor system comprising 
said lens 21 and sensor 20. Light ray traces 25 emanating from an object 24 are 
reunited at the pixel 23 of the sensor. 

The distance of the pixel 23 having the coordinates x, y from the center 22, 
20 having the coordinates X cen ter, Y cen ter, can be calculated using the equation: 

dlSt= tJ(X - Xcenter) 2 -(y- ycenter) 2 . (1) 

An algorithm to compensate lens shading is 

25 

Pixelnew = pixelold * fcorr, 

wherein the prior art correction factor f CO rr is calculated using the equation 

fcorr =1+f c x(1-COS<^ ) 4 ), (2) 
Of 

wherein the distance dist has been calculated using equation (1) above and the 
30 constant factors fc and df are dependent upon the geometry of the sensor system 
and the lens used. 
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It is obvious that the correction factor according to equation (2) is difficult to 
calculate and algorithms, which are easier to be calculated, are very desirable. 

The US patent application, serial number 10/379.863 filed on 
5 March 4. 2003 and assigned to the same assignee as the present invention 
describes a different method to compensate lens shading or vignetting in digital 
cameras. The compensation for vignetting is done in two steps. The first step is 
done during production of the camera unit and involves taking and analyzing an 
image of a test screen, preferably a gray test screen. This results in a set of e.g. 
io 5x5 coefficients describing a polynomial surface. The second step is done for 
each image that is taken by the camera and involves calculating and applying a 
gain-table based on polynomial coefficients to all pixels of the image to 
compensate vignetting. 

15 Other solutions dealing with the suppression of lens shading are described 

in the following patents: 

U. S. Patent (6,388,706 to Takizawa et al.) describes an image processing 
method for an electronic camera which includes a photoelectric element having 

20 plural sensors and color filters in plural different colors, wherein each of the plural 
sensors corresponds to a respective one of the color filters in the different colors. 
The method includes the steps of: obtaining a signal value from a target sensor; 
obtaining the first average value from signal values of the sensors; obtaining the 
second average value from signal values of the sensors and obtaining an 

25 interpolation value for a color, which is different from that of the color filter of the 
target sensor, of the target sensor according to the signal value from the target 
sensor, the first average value and the second average value. The vignetting of a 
lens causes a decrease in marginal brightness of an image field. However, if the 
correction for the decrease in marginal brightness is performed at the same time 

30 of performing white balance adjustment or/and gain adjustment, the correction for 
the marginal brightness may be performed upon decreasing the calculation 
volume. 



DS03-024 



3 



U. S. Patent (6,323,934 to Enomoto) discloses an image processing 
method in which at least one aberration of an optically recorded image selected 
from among lateral chromatic aberration, distortion, decrease on the brightness of 
the edge of image field and image blurring is- corrected based on lens 
characteristics of a taking lens and position information of the image. Additionally, 
an image processing apparatus comprises an acquiring section for acquiring 
information identifying a taking lens; a storage section for storing lens 
characteristics associated with the type of the taking lens; and a correction section 
which receives the corresponding lens characteristics of the taking lens from the 
storage section and corrects at least one aberration selected from among lateral 
chromatic aberration, distortion, vignetting and image blurring. High-quality 
images that are free from color mismatch, distortion, uneven brightness, blurring 
and other defects, or both vignetting and distortion can be outputted consistently. 

Summary of the invention 

A principal object of the present invention is to achieve a fast and efficient 
way to calculate correction values to compensate vignetting in digital cameras. 

In accordance with the object of this invention a method to compensate 
vignetting in digital cameras has been achieved. Said method comprises a 
multiplication of each pixel output of the array sensor of the camera with a 
variable correction factor defined for each pixel, wherein said variable correction 
factor depends upon the distance between each pixel and the center of said 
sensor array. 

Also in accordance with the object of this invention a method to 
compensate vignetting in digital cameras has been achieved. Said method 
comprises a multiplication of each pixel output of the array sensor of the camera, 
except pixels being close to the center, with a variable correction factor defined for 
said pixels, wherein said variable correction factor depends upon the distance 
between said pixels and the center of said sensor array. 
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Also in accordance with the objects of this invention a method to 
compensate vignetting in digital cameras has been achieved. Said method is 
using a correction factor for pixel output of its sensor array wherein the required 
computation comprises the following steps, first, to provide x, y coordinates for the 
5 pixels of the sensor array, to assign a first constant factor, describing the 
geometry of thelens/sensor system to a first variable f1, to assign a second 
constant factor, describing the geometry of the lens/sensor system to a second 
variable f2, to calculate the distance in x-direction between the location of a pixel 
and the center of the sensor array and assign it to a variable xdist to calculate the 

10 distance in y-direction between the location of a pixel and the center of the sensor 
array and assign it to a variable ydist. Furthermore the next steps describe to 
calculate the square of the total distance between the location of a pixel and the 
center of the sensor array and assign it to a variable dist2, to calculate the total 
distance between the location of a pixel and the center of the sensor array to the 

15 power of four and assign it to a variable dist4, to calculate a correction factor and 
assign to the variable fcorr according to the equation fcorr = 1 + f 1 x dist2 - f 2 x 
dist4, and to multiply said correction factor with the old pixel value to get a 
compensated pixel value. 

20 Furthermore in accordance with the objects of this invention a method to 

compensate vignetting in digital cameras has been achieved. Said method is 
using a correction factor for pixel output of its sensor array wherein the required 
computation comprises the following steps, first, to provide polar coordinates r 
and 9 for the pixels of the sensor array, wherein the center of the sensor array is 

25 the origin of said polar coordinates, to assign a first constant factor, describing the 
geometry of the lens/sensor system to a first variable f 1 , and to assign a second 
constant factor, describing the geometry of the lens/sensor system to a second 
variable f2. The next steps comprise to calculate the square of the coordinate r of 
a pixel and assign it to a variable dist2, to calculate the coordinate r of a pixel to 

30 the fourth power and assign it to a variable dist4, to calculate a correction factor 
and assign to the variable fcorr according to the equation fcorr = 1 + f 1 x 

dist2 - f2 x dist4, and to multiply said correction factor with the old pixel value to 
get a compensated pixel value. 
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Description of the drawings 

In the accompanying drawings forming a material part of this description, 
there is shown: 

Fig. 1 prior art shows a flowchart of the various steps performed to 
process images in a digital camera. 

Fig. 2a prior art shows a principal top view of a lens/sensor system 

Fig. 2b prior art shows a principal side view of a lens/sensor 
system 

Fig. 3 shows a graph describing principally how the correction factor 
fcorr depends upon the distance from the center of a sensor array. 

Fig. 4 shows a flowchart of a method to compute the compensation 
of vignetting 



Description of the preferred embodiments 

The preferred embodiments disclose a novel algorithm and a 
method to compute a correction factor to compensate lens shading or vignetting 
of digital cameras allowing the usage of a cheaper lens and still producing a high 
image quality in respect of vignetting. Said algorithm of the present invention can 
be can computed in a very fast and efficient way and consumes less power and 
time for tits computation. A correction factor is calculated for each pixel of the 
sensor used. 

At first for each pixel the square dist2 of its distance from the center of the 
image array (as shown in Figs. 2a and 2b prior art) has to be calculated: 
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dist2(X,y) = (X - X cen ter) 2 + (/ - y center? , (3) 

wherein X and y are the coordinates of a pixel and X cent er and Y cen ter are the 
5 coordinates of the center of an image array corresponding to the center of the 
lens used. The next step ids the calculation of the square dist4 of this squared 
distance dist2 has to be calculated: 

dist4(x,y) = (dist2) 2 . (4) 

10 

Both coefficients are used now to calculate a correction factor to 
compensate vignetting according to the following equation: 

Wx,yj = 1 + fixdist2 - f 2 x dist4 (5) 

15 wherein fcorr(x,y) is a correction factor applied to each pixel of the image sensor 
array, f1 is a constant dependent upon the geometry and quality of the 
lens/sensor system, and f2 is another constant dependent upon the geometry and 
quality of the lens/sensor system. The size of the lens, the size of the active 
sensor area, the distance between lens and sensor, the focal length, the thickness 

20 of the lens (depending on the material), and the quality of the lens are factors 
influencing said constants fj and f2. 

Finally the correction factor f C orr(x,y) is applied to the pixel stream by 
multiplication: 

25 

pixelnew(x,y) = fcorr(x,y) x pixel 0 id(x,y). (6) 

An alternative approach to define the distance between a pixel and the 
center of a sensor array is to use polar coordinates wherein the center of the 
30 sensor array would be the origin of the polar coordinates instead of x, y 
coordinates. The position of each pixel within a sensor array is known. Usually x 
and y coordinates are used to define the exact position of a pixel in a sensor 
array. Since the polar coordinates or positions are determined according to the 
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distance or radius from an origin, symbolized by r and the angle relative to a 
reference axis, symbolized usually by Greek 0, the distance between a pixel and 
the center of the sensor array, being the origin of the polar coordinates in this 
case, is already known by knowing said coordinate r. The angle 6 is not relevant 
in our case. 

Another alternative approach is not to compensate pixels being very close 
to the center of the sensor array. Vignetting effects does not influence pixels 
having very little distance to the center of the sensor array. This area has to be 
very small; otherwise a step (a circle around the center) is visible when the 
compensation starts in a distance too far away from the center. 

Lens shading is efficiently compensated using the compensation method of 
the present invention. Fig. 3 shows a graph describing principally how the 
correction factor W depends upon the distance from the center of a sensor array. 
The correction factor fcorr is greater than 1 and, within a usual range, rises faster 
the greater the distance is from the center of the sensor array. The fact, that the 
curve gets almost flat beyond a distance from the center of the sensor array 
greater than a maximum distance in typical sensor arrays is nor relevant. 

The flowchart of Fig. 4 describes a preferred algorithm to compute 
corrected pixel data in order to compensate lens shading. In a preferred algorithm, 
with the exception of the last step 47, a computation in integer format has been 
used to minimize the computation time required. Floating point computation could 
be performed as well. In the first step 40 the constant factor f,, used in equation 
(5), is loaded from a register. In the next step 41 the constant factor f 2 , used in 
equation (5) also, is loaded from a register. In the following step 42 the horizontal 
distance xdist from the center of the sensor array of a current pixel is calculated, 
followed by step 43, wherein the vertical distance ydist from said center is 
computed. In the next step 44 the square dist2 of the distance of said current 
pixel to the center of the sensor array is computed according to equation (3), 
followed by step 45 wherein the square dist4 of the square distance, according to 
equation (4), is computed, According to equation (5) the correction factors f co ^are 
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computed in step 46 and, finally, in step 47, according to equation (6), each of the 
original pixel values are multiplied with the related correction factors f CO rr to get the 
vignetting effects of the lens compensated 

5 



10 



15 



20 



25 
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Claims 



1. A method to compensate vignetting in digital cameras comprising a 
5 multiplication of each pixel output of the array sensor of the camera with a 
variable correction factor defined for each pixel, wherein said variable correction 
factor depends upon the distance between each pixel and the center of said 
sensor array. 

10 2. The method of claim 1 wherein said correction factor is calculated for each pixel 
using a first product of a first constant factor, describing the geometry and quality 
of the lens/sensor system, multiplied with the square of the distance between the 
pixel and the center of the sensor array, and a second product of a second 
constant, describing the geometry of the lens/sensor system with the distance 

15 between the pixel and the center of the sensor array to the power of four. 

3. The method of claim 2 wherein said calculation of the correction factor for each 
pixel output is using the equation: 

W = 1 + f1 xdist2 - f2xdist4, 

20 wherein Wr is the correction factor to be multiplied with each pixel output of the 
sensor array, f1 is a constant describing the geometry of the lens/sensor system, 
dist2 is the square of the distance between a pixel and the center of the sensor 
array, f2 is a constant describing the geometry of the lens/sensor system, and 
dist4 is the distance between said pixel and the center of the sensor array to the 

25 power of four. 

4. The method of claim 3 wherein x, y coordinates are being used to define the 
position of each pixel and said calculation of the correction factor for each pixel 
output is using the equation: 

30 fcorr(x, y) = 1 + f1 xdist2(x, y) - f2xdist4(x, y), 

wherein fcorr is the correction factor to be multiplied with each pixel output of the 
sensor array, f1 is a constant describing the geometry of the lens/sensor system, 
dist2(x, y) is the square of the distance between a pixel, having the coordinates x, 
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y, and the center of the sensor array, f2 is a constant describing the geometry of 
the lens/sensor system, and dist4 is the distance between said pixel, having the 
coordinates x, y and the center of the sensor array to the power of four. 

5. The method of claim 3 wherein polar coordinates are being used, having the 
center of the sensor array as origin, to define the position of each pixel and said 
calculation of the correction factor for each pixel output is using the equation: 

fcorr(/) = 1 +flxr2-f2xr4, 
wherein f corr is the correction factor to be multiplied with each pixel output of the 
sensor array, f1 is a constant describing the geometry of the lens/sensor system, 
r2 is the first polar coordinate r of a pixel to the power of 2, f2 is a constant 
describing the geometry of the lens/sensor system, and r4 is the first polar 
coordinate r of a pixel to the power of four. 

6. A method to compensate vignetting in digital cameras comprising a 
multiplication of each pixel output of the array sensor of the camera, except pixels 
being close to the center, with a variable correction factor defined for said pixels, 
wherein said variable correction factor depends upon the distance between said 
pixels and the center of said sensor array. 

7. The method of claim 6 wherein said correction factor is calculated for each 
pixel, except pixels being close to the center of the sensor array, using a first 
product of a first constant factor, describing the geometry and quality of the 
lens/sensor system, multiplied with the square of the distance between the pixel 
and the center of the sensor array, and a second product of a second constant, 
describing the geometry of the lens/sensor system with the distance between the 
pixel and the center of the sensor array to the power of four. 

8. The method of claim 7 wherein said calculation of the correction factor for each 
pixel output, except for pixels being close to the center of the sensor array, is 
using the equation: 

fcorr = 1 + f1 xdist2 - f2xdist4, 
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wherein f CO rr is the correction factor to be multiplied with each pixel output of the 
sensor array, f1 is a constant describing the geometry of the lens/sensor system, 
dist2 is the square of the distance between a pixel and the center of the sensor 
array, f2 is a constant describing the geometry of the lens/sensor system, and 
5 dist4 is the distance between said pixel and the center of the sensor array to the 
power of four. 

9. The method of claim 8 wherein x, y coordinates are being used to define the 
position of each pixel and said calculation of the correction factor for each pixel 

10 output, except for pixels being close to the center of the sensor array, is using the 
equation: 

Wx.y) = 1 + f1 xdist2(x,y) -f2xdist4(x,y), 
wherein W is the correction factor to be multiplied with each pixel output, except 
pixels being close to the center of the sensor array, of the sensor array, f 1 is a 
15 constant describing the geometry of the lens/sensor system, dist2(x, y) is the 
square of the distance between a pixel, having the coordinates x, y, and the 
center of the sensor array, f2 is a constant describing the geometry of the 
lens/sensor system, and dist4 is the distance between said pixel, having the 
coordinates x, y and the center of the sensor array to the power of four. 

20 

10. The method of claim 8 wherein polar coordinates are being used, having the 
center of the sensor array as origin, to define the position of each pixel and said 
calculation of the correction factor for each pixel output, except for pixels being 
close to the center of the sensor array, is using the equation: 

25 fcorr(/) = 1 + f1 x r2 - f2x r4, 

wherein fcorr is the correction factor to be multiplied with each pixel output, except 
pixels being close to the center of the sensor array, of the sensor array, f1 is a 
constant describing the geometry of the lens/sensor system, r2 is the first polar 
coordinate r of a pixel to the power of 2, f2 is a constant describing the geometry 

30 of the lens/sensor system, and r4 is the first polar coordinate r of a pixel to the 
power of four. 
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11. The method of claim 3 or 8 wherein said constant factors f1 and f2 depend 
upon the size of the lens, the size of the active sensor area, the distance between 
lens and sensor, the focal length, the thickness of the lens (depending on the 
material), and the quality of the lens. 

12. A method to compensate vignetting in digital cameras using a correction factor 
for pixel output of its sensor array wherein the required computation comprises 
the following steps: 

- providing x, y coordinates for the pixels of the sensor array; 

- assign a first constant factor, describing the geometry of the lens/sensor system 
to a first variable f 1 ; 

assign a second constant factor, describing the geometry of the lens/sensor 
system to a second variable f2; 

calculate the distance in x-direction between the location of a pixel and the center 
of the sensor array and assign it to a variable xdist; 

- calculate the distance in y-direction between the location of a pixel and the 
center of the sensor array and assign it to a variable ydist; 

- calculate the square of the total distance between the location of a pixel and the 
center of the sensor array and assign it to a variable dist2; 

- calculate the total distance between the location of a pixel and the center of the 
sensor array to the power of four and assign it to a variable dist4; 

- calculate a correction factor and assign to the variable fcorr according to the 
equation 

fcorr = 1 + f1 x dist2 - f2 x dist4; and 

- multiply said correction factor with the old pixel value to get a compensated pixel 
value. 

13. A method to compensate vignetting in digital cameras using a correction factor 
for pixel output of its sensor array wherein the required computation comprises 
the following steps: 

- providing polar coordinates r and 9 for the pixels of the sensor array, wherein 
the center of the sensor array is the origin of said polar coordinates; 
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- assign a first constant factor, describing the geometry of the lens/sensor system 
to a first variable f 1 ; 

- assign a second constant factor, describing the geometry of the lens/sensor 
system to a second variable f2; 

5 - calculate the square of the coordinate r of a pixel and assign it to a variable 
dist2; 

- calculate the coordinate r of a pixel to the fourth power and assign it to a variable 
dist4; 

- calculate a correction factor and assign to the variable fcorr according to the 
10 equation 

fcorr = 1 + f 1 x dist2 - f2 x dist4; and 

- multiply said correction factor with the old pixel value to get a compensated pixel 
value. 

is 14. The method of claim 12 or 13 wherein all computations with the exception of 
the multiplication with the correction factor are performed using in integer mode. 

15. The method of claim 12 or 13 wherein said correction factor is applied to all 
pixels of the sensor array. 

20 

16. The method of claim 12 or 13 wherein said correction factor is applied to all 
pixels of the sensor array, except pixels being close to the center of the sensor 
array. 
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ABSTRACT 



5 A method used for the compensation of vignetting in digital cameras has 

been achieved. The compensation for vignetting is performed by multiplying pixel 
output of the sensor array with a correction factor. In a preferred embodiment of 
the invention all pixels are multiplied with an adequate correction factor. 
Alternatively pixels, being close to the center of the sensor array, can be left 

10 unchanged. Said correction factor can be calculated in a very fast and efficient 
way by using two constant factors describing the specific geometry of the 
lens/sensor array system and by multiplying a first of said factors with the square 
of the distance between a pixel and the center of the sensor array and by 
multiplying a second of said factors with the distance between a pixel and the 

15 center of the sensor array to the power of four. The result of the second 
multiplication is subtracted from the result of the first multiplication and this result 
is added to one to get the final correction factor. Each original pixel output is 
multiplied with said correction factor to get output data compensated for the 
vignetting effects of the lens. 

20 

Fig4 
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